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ABSTRACT 

IS projects success is a complex concept, and its evaluation is complicated, unstructured 
and not readily quantifiable. Numerous scientific publications address the issue of 
success in the IS field as well as in other fields. But, little efforts have been done for 
processing indeterminacy and uncertainty in success research. This paper shows a 
formal method for mapping success using Neutrosophic Success Map. This is an 
emerging tool for processing indeterminacy and uncertainty in success research. EIS 
success have been analyzed using this tool. 
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1. Introduction 

For academics and practitioners concerned with computer-based Information Systems 
(IS), one central issue is the study of development and implementation project success. 
Literature (Barros et al., 2004; Poon and Wagner, 2001; Rainer and Watson, 1995; 
Redmil, 1990) suggest that IS projects have lower success rates than other technical 
projects. Irrespective of the accuracy of this presumption, the number of unsuccessful IS 
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projects are over the number of successful ones. Therefore, it is worthwhile to develop a 
formal method for mapping success, since proper comprehension of the complex nature 
of IS success is critical for the successful application of technical principles to this 
discipline. 

To increase the chances of an IS project to be perceived as successful for people 
involved in project, it is necessary to identify at the outset of the project what factors are 
important and influencing that success. These are the Critical Success Factors (CSF) of 
the project. Whereas several CSF analyses appear in the literature, most of them do not 
have any technical background. In addition, almost none of them focus on relations 
between them. In addition, it is important to discover the relationships between them. 
Research about it was becoming scarce. 

In this paper, we propose the use of an innovative technique for processing uncertainty 
and indeterminacy to set success maps in IS projects. The main strengths of this paper 
are two-folds: it provides a method for processing indeterminacy and uncertainty within 
success and it also allows building a success map. 

The remainder of this paper is structured as follows: Section 2 shows previous research; 
Section 3 reviews cognitive maps and its evolution; Section 4 is focused on the research 
model; Section 5 presents and analyzes the results; the final section shows the paper’s 
conclusions. 

2. Previous research 

Success is not depending to just one issue. Complex relations of interdependence exist 
between IS, organization, and users. Thus, for example, reducing costs in an 
organization cannot be derived solely from IS implementation. Studies indicate that the IS 
success is hard to assess because it represent a vague topic that does not easily lend 
itself to direct measurement (DeLone and McLean, 1992). 

According to Zviran and Erlich (2003), academics tried to assess the IS success as a 
function of cost-benefit (King and Schrems, 1978), information value (Epstein and King, 




1983; Gallagher, 1974), or organization performance (Turner, 1982). System acceptance 
(Davis, 1989) has used for it too. Anyway, cost-benefit, information value, system 
acceptance, and organization performance are difficult to apply as measures. 

Critical Success Factor method (Rockart, 1979) have been used as a mean for identifying 
the important elements of IS success since 1979. It was developed as a method to 
enable CEOs to recognize their own information needs so that IS could be built to meet 
those needs. This concept has received a wide diffusion among IS scholars and 
practitioners (Butler and Fitzgerald, 1999). 

Numerous scientific publications address the issue of CSF in the IS field as well as in 
other fields. But, little efforts have been done for introducing formal methods in success 
research. Some authors (Poon and Wagner, 2001) analysed some aspects of CSF just 
by the use of personal interviews, whereas others (Ragahunathan et al., 1989) carried 
out a Survey-based field study. Interviews and/or questionnaires are common tools for 
measuring success. However, formal methodology is not usual. 

On the other hand, Salmeron and Herrero (2005) propose a hierarchical model to model 
success. Anyway, indeterminacy was not processed. Therefore, we think that a formal 
method to process indeterminacy and uncertainty in IS success is an useful endeavour. 

3. Uncertainty and Indeterminacy processing in cognitive maps 
3.1. Cognitive mapping 

A cognitive map shows a representation of how humans think about a particular issue, by 
analyzing, arranging the problems and graphically mapping concepts that are connected 
between them. In addition, it identifies causes and effects and explains causal links (Eden 
and Ackermann, 1992). The cognitive maps study perceptions about the world and the 
way they act to reach human desires within their world. Kelly (1955, 1970) gives the 
foundation for this theory, based on a particular cognitive psychological body of 
knowledge. The base postulate for the theory is that “a person’s processes are 
psychologically canalized by the ways in which he anticipates events." Mental models of 




top managers in firms operating in a competitive environment have been studied (Barr et 
al., 1992) using cognitive mapping. They suggest that the cognitive models of these 
managers must take into account significant new areas of opportunity or technological 
developments, if they want stay ahead. In this sense, it is critical to consider mental 
models in success research. 

3.2. Neutrosophic Cognitive Maps (NCM) 

In fact, success is a complex concept, and its evaluation is complicated, unstructured and 
not readily quantifiable. The NCM model seems to be a good choice to deal with this 
ambiguity. NCM are flexible and can be customised in order to consider the CSFs of 
different IT projects. 

Neutrosophic Cognitive Maps (Vasantha-Kandasamy and Smarandache, 2003) is based 
on Neutrosophic Logic (Smarandache, 1999) and Fuzzy Cognitive Maps. Neutrosophic 
Logic emerges as an alternative to the existing logics and it represents a mathematical 
model of uncertainty, and indeterminacy. A logic in which each proposition is estimated to 
have the percentage of truth in a subset T, the percentage of indeterminacy in a subset I, 
and the percentage of falsity in a subset F, is called Neutrosophic Logic. It uses a subset 
of truth (or indeterminacy, or falsity), instead of using a number, because in many cases, 
humans are not able to exactly determine the percentages of truth and of falsity but to 
approximate them: for example a proposition is between 30-40% true. The subsets are 
not necessarily intervals, but any sets (discrete, continuous, open or closed or half-open/ 
half-closed interval, intersections or unions of the previous sets, etc.) in accordance with 
the given proposition. A subset may have one element only in special cases of this logic. 
It is imperative to mention here that the Neutrosophic logic is a strait generalization of the 
theory of Intuitionistic Fuzzy Logic. 

Neutrosophic Logic which is an extension/combination of the fuzzy logic in which 
indeterminacy is included. It has become very essential that the notion of neutrosophic 
logic play a vital role in several of the real world problems like law, medicine, industry, 
finance, IT, stocks and share, and so on. Fuzzy theory measures the grade of 




membership or the non-existence of a membership in the revolutionary way but fuzzy 
theory has failed to attribute the concept when the relations between notions or nodes or 
concepts in problems are indeterminate. In fact one can say the inclusion of the concept 
of indeterminate situation with fuzzy concepts will form the neutrosophic concepts (there 
also is the neutrosophic set, neutrosophic probability and statistics). 

In this sense, Fuzzy Cognitive Maps mainly deal with the relation / non-relation between 
two nodes or concepts but it fails to deal with the relation between two conceptual nodes 
when the relation is an indeterminate one. Neutrosophic logic is the only tool known to us, 
which deals with the notions of indeterminacy. 

A Neutrosophic Cognitive Map (NCM) is a neutrosophic directed graph with concepts like 
policies, events, etc. as nodes and causalities or indeterminates as edges. It represents 
the causal relationship between concepts. A neutrosophic directed graph is a directed 
graph in which at least one edge is an indeterminacy denoted by dotted lines. 

Let Ci, C 2 ,..., C n denote n nodes, further we assume each node is a neutrosophic vector 
from neutrosophic vector space V. So a node Q will be represented by (x-i, ...,x n ) where 
x k ’s are zero or one or I (I is the indeterminate introduced before) and x k = 1 means that 
the node C k is in the on state and x k =0 means the node is in the off state and x k = I 
means the nodes state is an indeterminate at that time or in that situation. 

Let C, and Cj denote the two nodes of the NCM. The directed edge from Q to Cj denotes 
the causality of Cj on Cj called connections. Every edge in the NCM is weighted with a 
number in the set {-1, 0, 1, I}. Let ey be the weight of the directed edge CjCj, ey C {- 
1,0, 1,1}. ey = 0 if C, does not have any effect on Cj, ey = 1 if increase (or decrease) in C, 
causes increase (or decreases) in Cj, ey = -1 if increase (or decrease) in Cj causes 
decrease (or increase) in Cj. ey = I if the relation or effect of C, on Cj is an indeterminate. 
The edge ey takes values in the fuzzy causal interval [-1, 1] (ey = 0 indicates no causality, 
ey > 0 indicates causal increase; that Cj increases as C, increases and Cj decreases as C, 
decreases, ey < 0 indicates causal decrease or negative causality Cj decreases as C, 




increases or Cj, increases as C, decreases. Simple FCMs have edge value in {-1, 0, 1}. 
Thus if causality occurs it occurs to maximal positive or negative degree. 

It is important to note that e,j measures only absence or presence of influence of the node 
C, on Cj but till now any researcher has not contemplated the indeterminacy of any 
relation between two nodes C, and Cj. When we deal with unsupervised data, there are 
situations when no relation can be determined between some two nodes. In our view this 
will certainly give a more appropriate result and also caution the user about the risks and 
opportunities of indeterminacy. 

Using NCM is possible to build a Neutrosophic Success Map (NSM). NSM nodes 
represent Critical Success Factors (CSF). They are the limited number of areas in which 
results, if they are satisfactory, will ensure successful competitive performance for the 
organization. They are the few key areas where “things must go right” for the project 
(Rockart, 1979). This tool shows the relations and the fuzzy values within in an easy 
understanding way. This is an useful approach for non-technical decision makers. At the 
same time, it allows computation as FCM. Figure 1 shows the NSM static context. 
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Figure 1 : NSM static context 
























5. Building a NSM 

EIS project have been used for building a Neutrosophic Success Map. EIS, or executive 
support systems as they are sometimes called, can be defined as computer-based 
information systems that support communications, coordination, planning and control 
functions of managers and executives in organizations (Salmeron and Herrero, 2005). 
NSM will be based on textual descriptions given by EIS experts on interviews with them. 
The steps followed are: 

1) Experts selection. It is critical step. Expert selection was based on specific 
knowledge of EIS systems. Experts are 19 EIS users of leading companies and 
EIS researchers. The composition of the respondents is important. Multiple 
choices were contemplated. The main selection criterion considered was 
recognized knowledge in research topic, absence of conflicts of interest and 
geographic diversity. All conditions were respected. In addition, respondents were 
not chosen just because they are easily accessible. 

2) Identification of CSF influencing the EIS systems. 

3) Identification and assess of causal relationships among these CSF. Indeterminacy 
relations are included. 

Experts discover the CSFs and give qualitative estimates of the strengths associated with 
causal links between nodes representing these CSFs. These estimates, often expressed 
in imprecise or fuzzy/neutrosophic linguistic terms, are translated into numeric values in 
the range -1 to 1. In addition, indeterminacy is used for modelling that kind of relations 
relationships among nodes. 

The nodes (CSFs) discover was the following: 

1. Users’ involvement (x^. It is defined as a mental or psychological state of users 
toward the system and its development process. It is generally accepted that IS 
users’ involvement in the application design and implementation is important and 
necessary (Hwang and Thorn, 1999). It is essential in maintenance phase too. 

2. Speedy prototype development (x 2 ). It encourages the right information needs 
because it interacts between user and system as soon as possible. 




3. Top management support (x 3 ). EIS support with his/her authority and influence 
over the rest of the executives. 

4. Flexible system (x 4 ). EIS must be flexible enough to be able to get adapted to 
changes in the types of problems and the needs of information. 

5. Right information requirements (x 5 ). Eliciting requirements is one of the most 
complicated tasks in developing EIS and getting a correct requirement set is 
challenging. 

6. Technological integration (x 6 ). EIS tool selected must be integrated in companies’ 
technological environment. 

7. Balanced development team (x 7 ). Suitable human resources are required for 
developing EIS. Technical background and business knowledge are needed. 

8. Business value (x 8 ). The system must solve a critical business problem. There 
should be a clear business value in EIS use. 

9. Change management (x 9 ). It is the process of developing a planned approach to 
change in a firm. EIS will be a new way of working. Typically the objective is to 
maximize the collective efforts of all people involved in the change and minimize 
the risk of failure of EIS project. 



The NSM find out is presented in Figure 2. Fuzzy values are included. 




Figure 2. EIS NSM 





The adjacency matrix associated to NSM is N(E). 
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The stronger relations are between x 5 to x 8 , x 7 to x 5 and x 8 to x 3 . It follows that a balanced 
development team has a positive influence over elicitation requirements process. In the 
same sense, eliciting right requirements have a positive influence over system business 
value and system business value over top management support. In addition, users’ 
involvement receives influence from six nodes. 

On the other hand, we have found two neutrosophic relations between x 4 to x 9 , x 5 to x 3 
and x 7 to x 9 . It follows that experts perceive indeterminacy in relations between EIS 
flexibility and balanced team skills to change management. They can not to assess the 
relation between them, but they perceive that relation could exist. It is an useful 
information since the decision-makers can be advised from it. They will be able to be 
careful with those relations. 

In addition, NSM predict effects of one or more CSFs (nodes) in the regarding ones. If we 
know that any CSFs are on, we can discover the influence over the others. This process 
is similar in Fuzzy Cognitive Maps. 

Let C l C 2 ,C 2 C 3 ,...,C n _ 1 C n be cycle (Vasantha-Kandasamy and Smarandache, 2003), 

when Ci is switched on and if the causality flow through the edges of a cycle and if it 
again causes Ci, we say that the dynamical system goes round and round. This is true for 
any node Ci, for i = 1 , 2,..., n. the equilibrium state for this dynamical system is called the 
hidden pattern. If the equilibrium state of a dynamical system is a unique state vector, 
then it is called a fixed point. If the NSM settles with a state vector repeating in the form 

Xl — > X 2 — > ... -> Xj -> Xi, 

then this equilibrium is called a limit cycle of the NSM. 

Let Ci, C 2 ,..., C n be the CSFs of an NSM. Let E be the associated adjacency matrix. Let 
us find the hidden pattern when x-\ is switched on when an input is given as the vector Ai 
= (1,0, 0,..., 0), the data should pass through the neutrosophic matrix N(E), this is done 
by multiplying Ai by the matrix N(E). Let A-|N(E) = (ai, a 2 ,..., a n ) with the threshold 




operation that is by replacing a, by 1 if a, > k and a, by 0 if a, < k and a, by I if a, is not a 
integer. 



f(k) = 



a. <k => a t = 0 
a. > k = 1 

a, = Z? + c x / => a. =b 
a. = cxl => a. = / 



This procedure is repeated till we get a limit cycle or a fixed point. According to this, the 
limit cycle or a fixed point of vector state of each CSFs is calculated with k=0.5. We take 
the state vector At = (1 0 0 0 0 0 0). We will see the effect of At over the model. 

A { N(E) = (0 0.8 0 0 0 0 0 0 0.6) >(l 1 0 0 0 0 0 0 1)=^ 

A 2 AT(£) = (0.8 0.8 0 0 0.2 0 0 0 0.6) >(l 1 0 0 0 0 0 0 l) = A 3 = A, 



A 2 is a fixed point. According with experts the on state of users’ involvement has effect 
over speedy prototype development and change management. 

We take the new state vector Ai = (1 0 1 0 0 0 0 0 0). We will see the effect of users’ 
involvement and top management support (Ai) over the model. 

A,Af(£) = (0.9 0.8 0 0 0.2 0 0 0 0.6) >(l 1 1 0 0 0 0 0 l) = A, 

A 2 N(E) = {1J 0.8 0 0 0.2 0 0 0 0.6) >(l 1 1 0 0 0 0 0 l)= A 3 = A, 



Thus A 2 =(1 1 1 0 0 0 0 0 1), according with experts the on state of users’ involvement and 
top management support have effects over the prototype speed of development (x 2 ) and 
change management (x 9 ). It is interesting to discover that both previous state vectors 
have the same influence over the model. Both vector states have influence over 
prototype speed of development (x 2 ) and change management, but no direct effect over 
the rest of CSFs. 

The vector states described are only two of the several available, even vectors with 
several CSFs on. However the proposal here presented is as simple as possible while 
being consistent with the process, data gathered from the expert’s perceptions, and the 
aims and objectives of the paper. 



6. Conclusions 




The main strengths of this paper are two-folds: it provides a method for project success 
mapping and it also allows know CSF effects over the other ones. In this paper, we 
proposed the use of the Neutrosophic Success Maps to map EIS success. 

A tool for evaluating suitable success models for IS projects is required due to the 
increased complexity and uncertainty associated to this kind of projects. This leads to the 
innovative idea of adapting and improving the existent Neutrosophic theories for their 
application to indicators of success for IS projects. 

Neutrosophic Success Map is an innovative success research approach. NSM is based 
on Neutrosophic Cognitive Map. The concept of NCM can be used in modelling of 
systems success, since the concept of indeterminacy play a role in that topic. This was 
our main aim is to use NCMs in place of FCMs. When an indeterminate causality is 
present in an FCM we term it as an NCM. 

The results not mean that any CSF is unimportant or has not effect over the model. It 
means what are the respondents’ perceptions about the relationships of them. This is a 
main issue, since it is possible to manage the development process with more 
information about the expectations of final users. 

Anyway, more research is needed about Neutrosophic logic limit and applications. 
Incorporating the analysis of NCM and NSM, the study proposes an innovative way for 
success research. We think this is an useful endeavour. 

7. References 

Axelrod, R. Structure of Decision: The Cognitive Maps of Political Elites, Princeton Univ. 
Press, New Jersey, 1976. 

Barr P.S., Stimpert J.L. and Huff A.S. Cognitive Change, Strategic Action, and 
Organizational Renewal, Strategic Management Journal 13 (1992), pp. 15-36. 

Barros, M.O.; Werner C.M.L. and Travassos, G.H. Supporting risks in software project 
management, Journal of Systems and Software 70 (2004) (1-2), pp. 21-35. 

Butler, T. and Fitzgerald, B. Unpacking the systems development process: an empirical 
application of the CSF concept in a research context, Journal of Strategic Information 
Systems 8 (4) (1999), pp. 351-371. 

Davis, F. D. Perceived usefulness, perceived ease of use, and user acceptance of 
information technology. MIS Quarterly 13 (1989) (3), pp. 319-340. 

Eastereby-Smith M., Thorpe R. and Holman D. 1996 “Using repertory grids in 
management” Journal of European Industrial Training 20, p. 3. 




Eden, C. and Ackermann, F. 1992 “Strategy development and implementation - the role 
of a group decision support system” in Holtham, C. Executive Information Systems and 
Strategic Decision Support, Unicom, Uxbridge, UK, pp. 53-77. 

Epstein, B.J. and King W.R. An Experimental Study of the Value of Information, Omega, 
10(3) (1983), pp. 249-258. 

Gallagher, C.A. Perceptions of the Value of a Management Information System, 
Academy of Management Journal, 17(1) (1974), pp. 46-55. 

Gordon M. and Tan F. 2002. “The repertory grid technique: A method for the study of 
cognition in information systems”. MIS Quarterly 26(1), p. 39. 

Hwang, M.l. and, Thorn, R.G. The effect of user engagement on system success: a meta- 
analytical integration of research findings, Information & Management 35 (4) (1999) 229- 
236. 

Kelly, G. 1970. “A brief introduction to personal construct theory”. Academic Press, 
London. 

Kelly, G. 1955. “The Psychology of Personal Constructs”. New York, Norton & Company. 
King, J.L. and Schrems, E.L. Cost-Benefits Analysis in IS Development and Operation, 
Computing Surveys 10 (1978), pp. 19-34. 

Kosko, B. Fuzzy Cognitive Maps, Int. J. of Man-Machine Studies, 24 (1986) 65-75. 

Nord, J.H. and Nord, G.D. Executive information systems: a study and comparative 
analysis, Information & Management 29 (2) (1995), pp. 95- 106. 

Poon P. and Wagner, C. Critical success factors revisited: success and failure cases of 
information systems for senior executives, Decision Support Systems 30 (2001) (4), pp. 
393-418. 

Ragahunathan, T.S., Gupta, Y.P. and Sundararaghavan, P.S. Assessing the impact of IS 
executives’ critical success factors on the performance of IS organisations. Information 
and Management 17 (3) (1989), pp. 157-168. 

Rainer Jr. R.K. and Watson, H.J. The keys to executive information systems success, 
Journal of Management Information Systems 12 (1995) (2), pp. 83- 98. 




Redmill, F. Considering quality in the management of software-based development 
projects. Information & Software Technology 32 (1990) (1), pp. 18-22. 

Rockart, J.F. Chief executives define their own data needs, Harvard Business Review 57 
(2) (1979) 81. 

Salmeron and Herrero, 2005. An AHP-based methodology to rank critical success factors 
of Executive Information Systems. Computer Standards and Interfaces 28 (1). pp. 1-12 
Smarandache, F. A Unifying Field in Logics: Neutrosophic Logic, American Research 
Press, Rehoboth, 1999. Available at http:// www.gallup.unm.edu/~smarandache/eBook- 
Neutrosophics2.pdf 

Turner, J.A. Firm Size, Performance and Computer Use, Proceedings of the Third 
International Conference on Information Systems, Ann Arbor: University of Michigan, 
(1982) pp. 109-120. 

Vasantha-Kandasamy, W.B. and Smarandache, F. Fuzzy Cognitive Maps and 
Neutrosophic Cognitive Maps, Xiquan, Phoenix, 2003, Available at www.gallup.unm. 
edu/~smarandache/NCMs.pdf 

Xirogiannis G., Stefanou J., and Glykas M. A fuzzy cognitive map approach to support 
urban design. Expert Systems with Applications 26 (2004), pp. 257-268. 

Zviran, M. and Erlich, Z. Measuring IS user satisfaction: review and implications, 12(5) 
(2003), pp. 1-36. 




